Deep In-memory Architectures for Machine Learning by Mingu Kang & Sujan Gonugondla & Naresh R. Shanbhag
Author:Mingu Kang & Sujan Gonugondla & Naresh R. Shanbhag
Language: eng
Format: epub
ISBN: 9783030359713
Publisher: Springer International Publishing
(4.14)
where B x is the precision of X, which is fixed at 8-b in this application. The precision B Δ = 16 is set as B x = 8 and batch sizes of up to N = 256 were to be accommodated.
It can be shown [73] that a necessary condition for convergence (stopping criterion) of the SGD update in (4.11) is given by,
(4.15)
The precision B WUD = 16 is set as algorithmic simulations indicate that the algorithm converges with a learning rate γ ≥ 2−15. In addition, the batch-mode algorithm offers an interesting trade-off between the batch size N and the learning rate γ, which will be studied in Sect. 4.3.2.
The regularization factor λ has an optimum value that lies in between an upper bound that constrains the magnitude of W and a lower bound needed to avoid overflow in the weight accumulator (4.11). It can be shown that a sufficient condition to prevent overflow in the weight accumulator is:
Download
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.
Computer Design | Control Systems |
DSPs | Embedded Systems |
Microprocessor Design | PIC Microcontroller |
Building Low Latency Applications with C++ by Sourav Ghosh(3268)
Fusion 360 for Makers by Lydia Sloan Cline(1995)
Networking A Beginner's Guide by Bruce Hallberg(1945)
But How Do It Know? by J. Clark Scott(1830)
Computers For Seniors For Dummies by Nancy C. Muir(1780)
Hands-On Linux for Architects by Denis Salamanca(1769)
Arduino Project Handbook, Volume 2: 25 Simple Electronics Projects for Beginners by Geddes Mark(1762)
Hack and HHVM by Owen Yamauchi(1682)
31 Days Before Your CompTIA A+ Exams (Shanette Luellen's Library) by Benjamin Patrick Conry(1671)
9781803246888-ENHANCING DEEP LEARNING WITH BAYESIAN INFERENCE by Unknown(1544)
MicroPython Projects by Jacob Beningo(1501)
Embedded Programming with Modern C++ Cookbook by Igor Viarheichyk(1488)
PrestaShop Recipes by Arnaldo Pérez Castaño(1476)
Hands-On Internet of Things with MQTT by Tim Pulver(1447)
Implementing Cellular IoT Solutions for Digital Transformation by Dennis McCain(1436)
Embedded Systems Architecture by Daniele Lacamera(1391)
Raspberry Pi Electronics Projects for the Evil Genius (Tab) by Norris Donald & Norris Donald(1389)
Getting Started with Soldering: A Hands-On Guide to Making Electrical and Mechanical Connections by Vinck Marc de(1387)
Mastering Kubernetes by Gigi Sayfan(1385)